NAVAL  POSTGRADUATE  SCHOOL 

Monterey,  California 


THESIS 

AGGREGATION  OF  MEASURES  OF 
EFFECTIVENESS  WITH  CONSTANT  SUM 
SCALING  METHOD  AND  MULTIPLE  REGRESSION 

by 

Hyung  Bae  Kim 

March  1979 

Thesis 

Advisor:                   G.  Lindsay 

Approved  for  public  release;  distribution  unlimited. 


Thesis 


DunrrxMnuBRm 

MVM.rOST6itAO(MIESCiMl 
H0inEiCy.CA93S«l 


NAVAL  POSTGRADUATE  SCHOOL 

Monterey,  California 


THESIS 

AGGREGATION  OF  MEASURES  OF 
EFFECTIVENESS  WITH  CONSTANT  SUM 
SCALING  METHOD  AND  MULTIPLE  REGRESSION 

by 

Hyung  Bae  Kim 

March  1979 

Thesis 

Advisor:                   G.  Lindsay 

Approved  for  public  release;  distribution  unlimited. 


UNCLAS.STFTm 


SeCUniTY   CLASSIFICATION   OF    THIS  PAGC  (Whmt  Data  Enlarad) 


REPORT  DOCUMENTATION  PAGE 


ne^OMT   NUMSCM 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


2.  aOVT   ACCCMION  MO. 


).    neci^iCNT's  CATALOG  NUMaew 


4.     T\rLE.  (and  Subllllm) 

Aggregation  of  Measures  of  Effectiveness 
with  Constant  Sum  Scaling  Method  and 
Multiple  Regression 


».  TfP€  or  «epo»»T  •  ^emoD  covered 
Master's  Thesis; 
March  1979 


«.  PCRFOnMIMQ  one.  MEPORT  NUMtKR 


7.     AUTMORfaJ 


t.     CONTRACT  OR   SRANT   NUMaCRraJ 


Hyung   Bae   Kim 


•  .     RCRFOMMINO  OROANIZATION   NAME   ANO   AOORCSS 

Naval  Postgraduate  School 
Monterey,  California   93940 


to.     RROQRAM   ELCWCNT.  PROJECT     TASK 
ARCA  *   WORK   UNIT   NUMMCRS 


1  I.     CONTROLLINC  OFFICE  NAME   ANO   AOONESS 

Naval  Postgraduate  School 
Monterey,  California   93940 


12.     REPORT    DATE 

March    1979 


II.     NUMaCR  OF   PACES 

61 


U.     MONITORING  AGENCY  NAME  *   AODRESKK  <M/faranl  /ran  Conlrailin*  OlUea) 


IS.     SECURITY    CLASS,   (at  Ihit  ripnn) 

Unclassified 


Ita.     DECLASSIFICATION/ 0O«NGRAOlHa 
SCHEDULE 


l«.     0ISTRI8UTION  STATEMENT  (at  iMt  Mapun) 

Approved  for  public  release;  distribution  unlimited, 


17.     DISTRIBUTION  STATEMENT  (at  Ma  m^miract  mtfnd  In  Blaak  30,  It  dlllarmn 


!••     SUPPLEMENTARY  NOTES 


It.     KEY  WONOS  (Cotutmtm  an  nwaraa  mtd»  II  nmemmair  «M  Idmtiltr  *r  iloe*  nim^ar) 

Weapon  system  effectiveness 


20.     ABSTRACT  (Canuimu  an  ,airaraa  ttdm  II  nmcaaamr  mt4  Idmnlllr  kr  ^lact  ma*«; 

This  thesis  explores  a  method  of  aggregating  the  measures 
of  effectiveness  of  a  weapon  system  from  its  characteristics. 
With  this  method,  the  constant  siom  method  and  multiple 
regression  are  used  to  develop  a  functional  relationship 
between  system  effectiveness  and  system  characteristics. 
As  an  example,  a  study  of  a  tank  weapon  system  was  conducted 


(Page  1) 


"T^,   1473 


EDITION  OF   I  MOV  ••  IS  OaSOLETX 
S/N   ai03-014-««0i   I 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (Whan  Dmim  Kmiarad) 


UNCLASSIFIED 


taeu'wTv  ei.*»li>'C»Tiow  o>  tmh  m*at.ro^m>  n.i«  «««>«< 


(20.   ABSTRACT   CONTINUED) 


It  was  concluded 


with  data  from  the  U.S.  Army  Armor  School, 
that  the  aqqregation  method  is  feasible,  and  that  for  the 
tank  system  studied,  the  reciprocals  of  system  characteristics 
give  a  good  estimating  equation  for  measuring  tank  system 
effectiveness . 


DD  Forni   1473 

s/N  "o^-ou-fieoi 


UNCLASSIFIED 


iccu«.Ty  CL*Mir.e*T.OM  o'  f  mi»  ^.otr".-"  o—  ""•'-> 


Approved  for  public  release j   distribution  ijnlimited . 


AGGREGATION  OF  MEASURES  OF  EFFECTr/n>IESS  WITH 
CONSTANT  SUM  SCALING  METHOD  /^IID  t^ULTIPLE  REGRESSION 


by 


Hyung  3ae ,.  Kim 
Lieutenant  Colonel,  Republic  of  Korea  /^xiny 
B.S.,  Korea  M-ilitary  Academy,  1963 


Submitted  in  partial  fulfilment  of  the 
requirement  for  the  degree  of 

MASTER  OF  SCIENCE  IN  OPERATIONS  RESEARCH 

from  the 

NAVAL  POSTGPsiiDUATE  SCHOOL 

March  1979 


DUDLEY  KNOX  UBRARV 
NAVAl  P0S1GRADUME  SCHOOl 
MOmtREt.  CA  93940 


ABSTRACT 

This  thesis  explores  a  method  of  aggregating  the 
measures  of  effectiveness  of  a  weapon  system  from  its 
characteristics.   With  this  method,  the  constant  sum  method 
and  multiple  regression  are  used  to  develop  a  functional 
relationship  between  system  effectiveness  and  system 
characteristics.   As  an  example,  a  study  of  a  tank  weapon 
system  was  conducted  with  data  from  the  U.S.  Army  Armor 
School.   It  was  concluded  that  the  aggregation  method  is 
feasible,  and  that  for  the  tank  system  studied,  the 
reciprocals  of  system  characteristics  give  a  good  estimating 
equation  for  measuring  tank  system  effectiveness. 
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INTRODUCTION 


We  often  find  measurement  problems  in  Operations 
Research  that  are  difficult  in  that  widely  used  concepts 
have  not  been  made  operational.   How  to  measure  the  effec- 
tiveness of  a  weapon  system  is  one  of  the  most  important 
tasks  in  military  affairs.   What  is  needed  is  some  method 
to  give  answers  to  such  questions  as  "^^ich  tank  is  more 
effective?",  or  "How  much  better  a  M60A1  is  than  a  T-62?" 

We  want  to  know  how  much  better  one  weapon  system  is 
than  another  among  sim.ilar  systems.   One  way  of  doing  this 
is  through  a  functional  relationship  between  system  effec- 
tiveness and  the  characteristics  of  the  system. 

In  this  paper  we  will  propose  and  demonstrate  a  way  of 
structuring  such  a  relationship  using  as  values  for  the 
effectiveness  of  weapon  systems  values  which  originally 
came  from  military  experts'  judgements.   Once  we  have  found 
such  a  function,  we  would  not  necessarily  require  experts 
judgements  again,  since  one  can  use  the  function  to  calcu- 
late the  effectiveness  of  a  proposed  weapon  system  from  its 
characteristics . 

Chapter  II  gives  the  concept  and  general  procedure  of 
this  approach  to  measuring  effectiveness.   For  an  illus- 
trative problem  we  will  discuss  the  selection  of  the 
systems  and  their  major  characteristics,  the  preparation  of 
questionnaires  and  the  selection  of  "expert"  judges. 


Hfi 


Using  information  from  the  judges,  we  will  show  in 
Chapter  III  how  to  compute  the  values  of  effectiveness  of 
weapon  systems  using  the  constant  sum  method.   In  seeking 
a  good  functional  relationship  between  systems  effective- 
ness and  system  characteristics,  we  will  use  an  APL  computer 
program  for  multiple  regression  and  explore  various  func- 
tional forms  by  transforming  the  data.   This  is  the  content 
of  Chapter  IV.    In  the  final  chapter,  we  will  summarize 
major  conclusions  and  observations  during  the  course  of 
this  research. 

It  must  be  emphasized  that  although  the  illustration 
study  presented  here  involves  the  effectiveness  of  a  main 
battle  tank,  our  purpose  is  to  demonstrate  a  proposed 
approach  to  the  measurement  of  systems  effectiveness,  and 
not  to  develop  effectiveness  relationships  for  main  battle 
tanks.   A  study  of  the  latter  type  would  require  resources 
in  excess  of  those  available  for  this  work. 


II.   DESIGN  AND  DATA  COLLECTION 

This  chapter  describes  the  proposed  method  of  finding  a 
useful  functional  relationship  between  weapon  system 
characteristics  and  the  overall  effectiveness  of  a  system, 
and  in  particular  describes  and  demonstrates  the  collection 
of  data  needed  for  this  approach.   First  we  will  give  the 
concept  of  the  method  and  the  general  procedure  we  are  going 
to  follow.   Then,  using  tanks  as  an  example,  we  will  discuss 
the  selection  of  systems  and  their  major  characteristics, 
and  comment  about  preparing  questionnaires. 

A.   CONCEPT  OF  THE  PROBLEM 

The  problem  we  are  interested  in  is  to  calculate  the 
overall  effectiveness  of  a  weapon  system  from  its  charac- 
teristics.  The  approach  here  will  be  to  demonstrate  how 
to  estimate  the  effectiveness  of  a  weapon  system  using  a 
scaling  method  [1] . 

Every  weapon  system  has  its  own  characteristics  and  if 
we  have  a  value  for  the  overall  effectiveness  of  that  system, 
we  should  be  able  to  obtain  or  fit  a  relationship  expressing: 


Overall  effectiveness   _   ^,v  v        v  ^  /■1^ 

of  a  weapon  system  12        m 


where 


X, ,X„,  ...,  X  are  system  characteristics, 
12        m      -^ 


The  purpose  of  this  paper  is  to  show  a  procedure  for 
obtaining  values  for  overall  effectiveness,  and  a  way  of 
determining  the  function  f.   Since  we  will  be  fitting  func- 
tions to  data,  the  more  instances  of  the  system  we  use,  the 
better  the  functional  relationship  we  can  find. 

Figure  1  shows  the  relationship  between  characteristics 
and  system  effectiveness. 

SYSTEM  CHARACTERISTICS 

INSTANCE     EFFECTIVENESS  X,  , X_ ,  X 

12  m 

■*•  ^1  ^11 '^12 ^Im 

^  ^2  ^21 '^22 '^2m 

^  ^3       ^    ^   J  ^31'^32 ^3m 


n  Y  x„T  ,x^^ X 

n  nl   n2  nm 


FIG.  1   RELATIONSHIP  BETWEEN  EFFECTIVENESS 
AND  CHARACTERISTICS 


There  are  n  instances  of  the  system  and  thus  n  effectiveness  / 
values  which  have  to  be  obtained.   The  system  has  m  char-     | 
acteristics  which  we  presume  to  relate  to  effectiveness, 
and  assume  m  <  n.   If  we  express  this  figure  in  a  mathematical 
equation  we  would  write: 


Y.   =   f(X.,,X.T,  ...,X.  )  (2; 

1         il   i2'        im 
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describing  overall  effectiveness  of  a  system  as  a  function 
of  its  characteristics,  aiid  we  propose  to  show  how  to 
obtain  values  for  the  Y. ,  and  how  to  find  a  good  fitting 
function  f. 

B.   GENERAL  STUDY  PROCEDURE 

The  general  study  procedure  is  composed  of  3  steps. 

Step  1.   Design  of  the  study-   In  this  step  we  have  to 
select  the  instances  of  the  system  and  the  major  charac- 
teristics of  that  system,  and  collect  the  data  to  provide 
characteristic  values  for  each  selected  instance.   A  scaling 
method  must  then  be  chosen  by  which  we  can  quantify  information 
from  judges  about  system  effectiveness.   After  doing  this, 
we  prepare  questionnaires  and  send  them  to  selected  judges 
to  obtain  information  from  them  about  the  effectiveness 
of  the  system. 

Step  2.   Computation  of  the  effectiveness  of  each 
instance  of  the  system.   The  questionniares  sent  to  the 
judges  are  to  obtain  expert  judgement,  which  may  be  expressed 
as  a  ranking  of  systems  or  as  a  ratio  scale  value  of  effec- 
tiveness, according  to  the  requirement  of  the  scaling  method 
which  has  been  selected.   Based  on  this  information,  the 
next  thing  to  do  is  to  use  the  scaling  method  to  compute 
the  effectiveness  of  each  instance  of  the  system. 

Step  3.   Determination  of  the  functional  relationship. 
Once  we  have  the  numberical  values  of  effectiveness  and  the 
characteristics  for  each  system,  the  next  step  is  similar  to 


■\ 
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finding  a  cost  estimating  equation  [2].   Because  of  many 
characteristics  and  instances  of  the  system,  it  seems 
reasonable  to  use  the  multiple  regression  technique  to 
find  a  good  estimating  equation.   Since  we  will  not  restrict 
ourselves  to  the  linear  equation  case,  there  are  many 
candidate  functions  available  by  transforming  the  data. 
Therefore  we  have  to  choose  the  best  functional  relation- 
ship by  evaluating  these  candidate  equations.   This  whole 
procedure  is  represented  in  Figure  2. 

C.   DETAILED  PROCEDURE 

We  will  discuss  the  elements  of  the  design  of  the  study 
in  detail  in  this  section.   Steps  2  and  3  (computation  of 
effectiveness  and  determination  of  a  functional  relationship) 
will  be  discussed  in  detail  in  Chapters  III  and  IV. 
1.   Selection  of  the  Competing  Systems 

Among  various  types  of  weapon  systems  we  could  use 
as  the  example  in  this  paper,  let's  consider  the  tank 
weapon  system.   What  kind  of  tank  should  we  choose?   It 
depends  on  what  we  are  going  to  do  with  the  tanks,  and  since 
we  want  to  decide  which  tank  system  is  good  for  battle ,  we 
shall  choose  Main  Battle  Tanks  (MBTs)  [3] . 

We  shall  define  Main  Battle  Tanks  (MBTs)  as  the 
greatest  number  of  tanks  a  country  has  for  battle.  For 
this  study  six  Main  Battle  Tanks  were  chosen: 
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and 


M4  8A5  (Korea) , 

M60A1  (U.S.A.), 

AMX-30  (France), 

LEOPARD  1  (W.  Germany), 

T-62  (U.S.S.R.), 

CENTURION  (Mk.l3)      (Great  Britain) 


The  reason  why  these  tanks  are  chosen  is  that  (1)  these 
are  all  Main  Battle  Tanks  that  are  currently  in  service,  and 
(2)  they  are  very  well-known  tanks  so  that  the  experts  can 
give  knowledgeable  information.   If  some  of  the  tanks  were 
older  ones  not  in  service  or  tanks  under  development,  some 
judges  might  not  be  familiar  with  them. 

As  mentioned  before,  the  more  tanks  used  in  the 
study,  the  better  is  the  relationship  that  may  be  obtained. 
The  reason  for  using  only  six  MBTx  here  relates  to  the  work- 
load that  is  placed  on  the  judges.   In  the  constant  sum 
scaling  method  which  we  are  going  to  use,  each  judge  is 
asked  to  consider  each  possible  pair  of  instances  and  split 
100  points  between  the  two  instances  in  each  pair.   Thus  for 
n  instances  to  be  scaled,  n(n-l)/2  pairs  must  be  considered 
by  each  judge.   Therefore  we  have  to  consider  the  number  of 
instances  to  be  scaled  because  the  greater  the  number  of 
instances,  the  greater  the  workload  asked  of  each  judge 
and  the  less  careful  he  might  be  in  his  rating  and  the  smaller 
proportion  of  questionnaires  we  would  expect  to  be  returned. 
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since  "the  more  judges  the  better"  is  particularly  an  axiom 
in  scaling,  tradeoffs  may  have  to  be  made  between  the  effort 
that  will  be  required  of  a  judge  and  the  amount  of  confidence 
one  wishes  to  have  in  the  resulting  scale.   Our  selection 

of  six  tanks  (instances)  requires  — ~ =  15  pairs  of  tanks 

to  be  considered,  and  this  number  is  thought  reasonable  for 
a  judge  to  handle  in  a  short  period  of  time. 

2 .   Selection  of  the  iMajor  Characteristics 

There  are  of  course  many  characteristics  which 
affect  the  effectiveness  of  a  system.   For  example,  one 
source  lists  about  30  characteristics  which  are  deemed 
relevant  to  the  importance  of  a  tank  system  [3]. 

Some  of  the  characteristics  have  very  similar  values 
among  various  lyiBTs ,  and  these  characteristics  should  not 
make  any  substantial  difference  in  the  comparison  of  effec- 
tiveness among  the  competing  systems.   Thus  we  don't  need  to 
consider  this  kind  of  characteristic. 

We  have  chosen  4  tank  characteristics  as  follows : 

1.  speed 

2.  silhouette 

3 .  Hp/ton 

4 .  armor . 

These  characteristics  are  not  necessarily  the  most  important 
ones.   For  example,  fire  power  is  a  very  important  considera- 
tion, but  obtaining  useful  numerical  data  on  fire  power  is 
very  difficult  due  to  a  lack  of  a  standard  measurement  criterion 
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For  fire  power,  we  could  consider  the  main  gun,  but  all  the 
selected  Main  Battle  Tanks  have  a  similar  main  gun  with 
caliber  105  mm  except  T-62  which  has  115  mm  main  gun. 
Therefore  we  have  chosen  the  above  characteristics  as 
generally  accepted  important  factors,  which  should  serve 
well  in  our  demonstration  of  a  method  for  assessing  system 
effectiveness. 

3 .   Collection  of  Data 

After  selecting  the  system  instances  and  the  major 
characteristics  for  the  study,  we  have  to  collect  data  for 
each  characteristic.   Table  I  shows  the  basic  data  [3]  of  the 
six  Main  Battle  Tanks,  which  we  will  use.   Clearly,  one  should 
use  all  the  information  sources  available:   manufacturer, 
military  sources,  or  technical  reports. 

Table  I.   CHARACTERISTICS  OF  SIX  MAIN  BATTLE  TAl^JKS  [3] 


CHARACTERISTICS 
SYSTEMS 

LEOPARD  1 

M60A1 

T-62 

M48A5 

CENTURION 
(Mk.l3) 

AMX-30 


APJyiOR         SILHOUETTE       SPEED    ^     ,^^^ 
(mm  on  nose)   (height  in  n)   (km/hr)    p  " 


70 

110 
100 
110 

118 

48 


2.64 

3.26 

2.4 

3.09 

3.01 

2.85 


65  20.7 

48.3  15.3 

50  19.2 

48.2  15.9 

34.6  12.5 


65 


19.4 
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4 .  Selection  of  the  Method 

There  are  many  scaling  methods  we  could  use  for  our 
study  such  as  a  numerical  method,  the  constant  sum  method, 
a  comparative  method,  or  a  categorical  method.   For  our 
study  we  want  to  know  how  much  better  one  system  is  than 
another.   In  other  words,  we  want  a  ratio  scale  that  can  be 
used  for  directly  comparing  two  systems. 

Among  those  scaling  methods  the  constant  sum  method 
will  give  a  ratio  scale  which  is  easy  to  use.   We  can  convert 
the  information  from  judges  about  system  effectiveness  into 
a  ratio  scale.   Therefore  the  constant  sum  method  was  chosen 
for  the  illustrative  study  of  tank  effectiveness. 

5 .  Preparation  of  the  Questionnaire 

This  is  one  of  the  most  important  parts  of  the 
analysis.   The  questionnaire  should  be  prepared  very  care- 
fully with  a  clear  explanation  of  how  to  fill  it  out, 
together  with  information  about  the  systems  which  the  judges 
can  use  to  assist  them  in  their  ratings,   Since  v/e  are  going 
to  use  the  constant  sum  method  to  compute  the  effectiveness , 
the  judges  will  be  asked  to  make  ratio  scale  judgements  by 
splitting  100  points  between  the  two  instances  represented 
by  each  possible  pair  of  n  tanks.    For  example  a  judge 


Alternately,  of  course,  one  could  gather  information  from 
a  judge  by  asking  for  a  numerical  effectiveness  rating  for  each 
tank,  so  that  a  judge  would  assign  a  number  to  each  tank 
reflecting  how  effective  he  thought  it  was.   This  process,  however, 
is  a  very  difficult  rating  task  for  the  judge.   Literature  in 
psychometrics  suggests  that  judges  will  reflect  their  feelings 
more  accurately,  and  with  more  confidence,  if  they  are  given  just 
two  instances  at  a  time  to  rate,  as  in  the  constant  sum  method  [1] . 
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might  split  the  100  points  as 

M60A1     80_  T-6  2     20_ 

if  he  thinks  M60A1  is  much  better  (4  times  in  this  example) 
than  the  T-62  or  he  might  split  the  100  points  as 

M60A1     50  T-62     50_ 

if  he  thinks  they  are  equal  in  terms  of  combat  effectiveness. 

For  our  study  we  have  six  instances,  and  therefore 
there  are  15  pairs  to  be  presented  to  the  judges  (the  ques- 
tionnaire which  was  used  is  shown  in  Appendix  A) . 

The  questionnaire  actually  used  consisted  of  two 
parts,  seeking  ratings  on  both  overall  tank  effectiveness 
and  on  the  contribution  to  tank  effectiveness  of  various 
characteristics.   Scaled  values  from  the  second,  supplemen- 
tary study  are  given  in  Appendix  C  and  may  be  of  interest: 
to  readers. 

6 .   Selection  of  the  Judges 

There  appears  to  be  no  rule  or  standard  for  desig- 
nating individuals  as  "experts".   It  depends  on  common  sense 
or  military  judgements. 

We  believe  that  the  armor  officers  in  the  U.S.  Army 
Armor  school  may  be  considered  experts  about  tanks.   There- 
fore we  selected  them  as  judges  and,  after  obtaining  the 
gracious  cooperation  of  the  Armor  School,  sent  5  0  question- 
naires to  them.   The  50  questionnaires  were  completed  by 
all  ranks  ranging  from  Lieutenant  to  flag  officer,  and  all 
50  questionnaires  were  returned,  ready  for  analysis. 
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So  far  in  this  paper  we  have  structured  the  approach, 
selected  the  systems  we  are  interested  in  evaluating, 
collected  data  on  those  systems,  selected  an  analytic 
method  and  prepared  the  questionnaires  for  the  judges. 
In  the  next  chapter  we  will  describe  how  the  overall 
effectiveness  values  were  computed  from  the  information 
provided  by  the  judges. 
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III.   COMPUTATION  OF  SYSTEM  EFFECTIVENESS 

In  the  previous  chapter  we  showed  how  the  model  was 
organized,  and  how  the  questionnaires  were  prepared  for  the 
judges.   In  this  chapter  we  will  explain  the  constant  sum 
scaling  method  of  computing  the  overall  effectiveness  values 
for  each  system  instance,  using  the  information  received 
from  the  judges. 

A.   CALCULATION  OF  THE  EFFECTIVENESS  OF  EACH  WEAPON  SYSTEM 
USING  THE  CONSTANT  SUM  SCALING  METHOD 

The  constant  sum  scaling  method  is  designed  to  scale  a 
property  with  a  natural  origin  or  an  origin  upon  which  the 
judges  agree.   Judges  are  asked  to  allocate  100  points 
between  two  instances,  considering  each  possible  pair  of 
instances.   Thus  the  resulting  scale  for  instances  of  the 
property  is  taken  as  a  ratio  scale.   In  the  following  para- 
graphs we  will  explain  how  the  scale  values  are  obtained. 

Let  a. .  be  the  number  of  points  out  of  100  which  a 
judge  awards  to  instance  j  when  it  is  compared  to  instance 
i.   If  we  arrange  a  judge's  responses  in  an  array  a. ., 
there  will  be  one  array  for  each  judge  in  which  values  on 
the  diagonal  would  be  set  at  50  because  comparing  something 
with  itself  should  be  50:50. 

We  could  average  these  arrays  over  the  N  judges  to 


produce  an  array  a- •  where 
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I  a.. 

a =   over  all  judges  ,^. 

ij  ■  N  ^    ' 


and  the  values  on  the  diagonal  remain  set  at  50.   Table  III 
shows  the  a. •  values  for  this  study,  as  computed  from  the 
data  collected  from  50  judges  (the  50  a. .  arrays  of  individual 
judges  are  omitted) . 

From  Table  III  one  may  see,  for  example,  that  the 
average  of  the  judges'  100-point  split  in  overall  tank 
effectiveness  between  the  T-62  and  the  AMX-30  was  55.9  for 
the  T-62  and  44.1  for  the  AMX-30. 


Table  III 

a  .  . 

Array  Computed  from 

Judges  '  Resp' 

onses 

CENTURION 

M4  8A5 

M6  OAl 

AMX-30 

LEOPARD 

1 

T-62 

(Mk.l3) 

M4  8A5 

50 

56.94 

45.1 

64.22 

54.7 

45.4 

iM60Al 

43.06 

50 

39.14 

54.44 

45.04 

39.36 

AMX-30 

54.9 

60.86 

50 

63.86 

55.9 

49.7 

T.ROPARD  1 

35.78 

45.56 

36.14 

50 

41.46 

37.54 

T-62 

45.3 

54.96 

44.1 

58.54 

50 

44 

CENTURION 

54.6 

60.64 

50.3 

62.46 

56 

50 

(Mk.  13) 

The  next  step  is  to  construct  a  new  W. .  array  where  the 
entries  are  the  ratios  of  the  instance  values  across  the 
diagonal,  or 


21 


w.  .  = 


J:i. 


■Jl 


(4 


Of  course  the  diagonal  entries  in  the  W. .  array  should  be 
1.0.   In  this  array,  it  is  immediately  apparent  that  the 
entry  in  the  ith  row  and  jth  column  is  the  reciprocal  of 
that  in  the  jth  row,  and  ith  column,  i.e.. 


W. 


1] 


w 


(5; 


ji 


Values  of  w. .  for  the  tank  data  were  computed  from  the 
data  in  Table  III,  and  are  shown  in  Table  IV. 


Table  IV.   W. .  Array 


CENTURION 

^■ 

M4  8A5 

M60A1 

AMX-30 

LEOPARD  1 

T-62 

(Mk.l3) 

M48A5 

1 

1.322 

.821 

1.735 

1.207 

.831 

M60A1 

.756 

1 

.643 

1.195 

.819 

.649 

AMX-30 

1.217 

1.555 

1 

1.767 

1.267 

.988 

LEOPAED  1 

.557 

.837 

.566 

1 

.708 

.601 

T-62 

.828 

1.220 

.789 

1.412 

1 

.786 

CENTURION 

1.203 

1.541 

1.012 

1.664 

1.273 

1 

(Idk.  13) 

Since  W. .  is  the  ratio  of  the  average  points  awarded  to 
j  (when  compared  to  i)  to  the  average  points  awarded  to  i 
(when  compared  to  j ) ,  then  in  general,  if  S.  and  S-  are  the 
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scale  values  we  seek,  W. .  is  an  estimate  of  the  ratio 
S./S..   Thus  in  terms  of  the  Table  IV  data,  for  example, 
judges  have  indicated  that  they  feel  that  the  M60A1  tank 
is  1.322  times  more  effective  than  the  M43A5  tank.   The 
solution  is  overdetermined,  however,  since  there  are  far 
more  W. .  ratios  (fifteen)  than  there  are  scale  values  to 
be  estimated  (six).   For  example,  one  could  also  compare 
the  M60A1  and  the  iM48A5  by  comparing  both  against  the 
Leopard  1,  and  in  this  case  the  iM6  0Al  would  be  judged 

0-837   ^   1  503 
0.557      1-3UJ 

times  better  than  the  M4  8A5. 

We  propose  to  handle  this  multiple  estimate  problem 
by  a  least  squares  approach  over  the  estimates. 

We  could  write 


^ij  =  ^TT  ^'^ 


by  taking  the  log  of  both  sides  of  (6) ,  we  have 


log  S .  -  log  S^   =   log  W^ . , 


or 


log  W. .  -  (log  S.  -  loa  S.)   =   0 


(7) 


For  the  least-squares  approach  we  wish  to  obtain  values  of 

S .  and  S •  which  will  make 
3       X 
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log  W. .  -  (log  S.  -  loQ  S.) 


close  to  zero  over  all  instance  pairs  i,j.   Thus  we  want 

to  find  values  of  St,S-,  ...,  S   such  that 

12        n 


n   n 
Q      =        I         I    [log  W^j  -  (log  Sj  -  log  S^) ] ^   (8) 
i=l  j=l 


in  minimized. 

Algebraically  expanding  (8),  we  have 


n    n 

2 

Q      =        I         I     [log  W. .  -  2  log  W. .  log  S.  +  2  log  W. .  log  S. 

i=l  j=l 

2  2 

+  log  S-  -  2  log  S.  log  S.  +  log  S.]. 


In  order  to  solve  for  the  values  of  S ■  which  will  minimize 
Q,  we  take  the  n  partial  derivatives  of  Q  with  respect  to 
S.  and  set  them  equal  to  zero.   Thus 


^    '^   -2  log  W.  .   2  log  S.    2  log  S. 


n    n 

I         I    [-log  W^.+  log  S.  -  log  S^]   =   0  , 
i=l  j=l        ^ 

n    n  n  n  n    n 

I        Z  log  Sj   =    I  I    log  W^j  +   [    I    log  S^  , 

i=l  j=l  i=l  j=l  i=l  j=l 


24 


and  finally, 


n  n 

I    log  W. j    I    log  S^ 

log  s  .   =  ^^^ +  ^^^ ,   j  =  1 ,  2  ,  .  .  .  ,  n 


(9) 


Since  the  choice  of  a  unit  for  the  scale  is  arbitrary, 
we  will  choose  one  such  that  the  average  of  the  logs  of 
the  scale  value  is  zero,  or 


n 

I   log  Sj_ 
i=l 


n 


=   0  . 


Thus  equation  (9)  becomes 


n 


y  log  W. . 
log  S^   =  ^=^ — ,   j  =  1,2,  ...,  n  .    (lO; 


The  estimated  scale  values,  S.,  are  given,  of  course,  by 


the  an ti logarithms  of 


n 

I    log  W. . 

i=l 

n. 
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If  we  take  the  antilogarithms  of 


n 

y  log  W. . 

i=l 

n 


equation  (10)  becomes 


n 


Sj   =    n  (W^.)^/"  ,   j  =  1,2,  ... ,  n    (11) 
1=1 


Therefore  the  scale  value  of  instance  j ,  S . ,  derived  from 
the  least  square  approach  can  be  interpreted  simply  as  a 
Geometric  mean  of  the  jth  column  of  the  W. ^  array.   Using 
Table  IV  (W. .  array)  and  equation  (11),  we  obtained  S. 
values  as  follows: 


S-^  =  0.89 

S^  =  1.22 

S^  =  0.78 

54  =  1.44 

55  =  1.02 

S^  =  0.79 
o 


These  ratio  scale  values  for  the  overall  effectiveness  of 
six  tank  weapon  systems  will  be  discussed  in  the  next 
section. 
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B.   SYSTEM  EFFECTIVENESS  VALUES 

At  last  we  have  ratio  scale  values  for  the  relative 
effectiveness  of  each  tank  as  shown  in  Table  V. 

Table  V.   EFFECTIVENESS  OF  SIX  MAIN  BATTLE  TANKS 


TANK 

M4  8A5 

M60A1 

AMX-30 

LEOPARD  1 

T-62 

CENTURION 
(r4k.  13) 


EFFECTIVENESS 
0.89 
1.22 
0.78 
1.44 
1.02 
0.79 


If  we  represent  these  effectiveness  values  graphically,  they 
would  appear  as  in  Figure  3. 

2.0-T 


1.5-, 


1.0-^ 


0.5 


o.ol 


-«  LEOPARD  1 
^  M6  0A1 


-o   T-62 

^  M4  8A5 

-o  CENTURION 


AMX-30 


FIG.  3   EFFECTIVENESS  OF  SIX  tlAIN  BATTLE  TANKS 
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The  effectiveness  values  calculated  above  and  shown  here 
are  relative  effectiveness  values,  and  have  no  physical 
units. 

An  advantage  of  using  a  scaling  method  which  requires 
that  the  judges  provide  ratio  scale  information  is  that  the 
output  is  also  a  ratio  scale.   This  is  very  advantageous 
in  interpreting  the  results  in  that,  for  example,  we  can 
say  the  Leopard  1  is  more  effective  (or  better)  than  the 
AMX-30  by 


"■'''    -  °-^3.  X  100  =      46% 


1.44 


Such  a  statement  would  not  be  possible  if  the  scale  was 
interval  or  less.   The  effectiveness  value  by  itself  is 
meaningless,  but  because  this  is  a  ratio  scale,  we  can 
compare  the  two  systems  directly  by  ratios ,  and  can  say 
how  much  better  one  is  than  the  other. 

In  this  chapter  we  have  computed  the  effectiveness 
of  six  tank  weapon  systems  using  the  constant  sum  scaling 
method.   This  scaling  approach  provides  an  effective  way  of 
computing  the  overall  effectiveness  of  weapon  system.s . 
However,  this  use  of  a  scaling  method  alone  requires  that 
we  have  to  send  questionnaires  everytime  we  want  to  calcu- 
late the  effectiveness  of,  say,  a  new  or  different  Main 
Battle  Tank.   This  is  because  the  effectiveness  we  computed 
is  based  on  the  information  given  by  the  judges,  but  not 
directly  on  the  system  characteristics . 
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In  the  next  chapter,  we  are  going  to  find  a  functional 
relationship  between  the  effectiveness  computed  from  the 
information  given  by  the  judges  and  the  characteristics  of 
systems.   Such  a  relationship  could  be  used  in  subsequent 
analyses  instead  of  sending  questionnaires. 
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IV.   DETERMINATION  OF  A  FUNCTIONAL  RELATIONSHIP 
FOR  SYSTEM  EFFECTIVENESS 

In  the  previous  chapter  we  computed  the  effectiveness 
of  six  Main  Battle  Tanks,  and  we  have  the  characteristics 
of  these  systems  from  Chapter  II.   In  this  chapter,  we 
are  going  to  find  a  function   which  relates  the  character- 
istics to  the  effectiveness  values.   With  the  data  shown 
in  Table  I  (characteristics) ,  tank  characteristics  can  be 
thought  of  as  explantory  variables  and  the  effectiveness 
can  be  thought  of  as  a  dependent  variable  for  che  multiple 
regression  [2]  analysis  which  will  now  be  discussed. 

A.   SEARCHING  FOR  A  FUNCTIONAL  RELATIONSHIP  BETVJEEN 
EFFECTIVENESS  AITO  SYSTEM  CHARACTERISTICS  USING 
MULTIPLE  REGRESSION 

Since  there  are  six  dependent  variables  (six  Main 
Battle  Tanks)  and  four  explanatory  variables  (four  character- 
istics), computational  work  [4]  is  simplified  with  a 
computer  program  for  linear  and  non-linear  multiple 

regression.   There  exists  a  very  useful  APL  computer 

2 
program  for  multiple  regression  named  "REGRESS",   which 

will  be  used  to  find  a  good  functional  relationship  between 

effectiveness  and  system  characteristics. 

The  "REGRESS"  program  does  a  multiple  regression  analysis 

relating  the  dependent  variables  Y  to  a  set  of  explanatory 


2 

See  Appendix  B. 
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variables  X.   Here  Y  is  a  vector  of  size  n  and  the  right 
hand  argioment  X  is  an  nxm  matrix  consisting  of  n  observa- 
tions on  each  of  m  variables,  corresponding  to  the  tank 
characteristic  data  in  Table  I. 

Output  consists  of  an  ANOVA  table,  coefficient  of 

2 
determxnation  R  ,  Standard  Error  SE,  regression  coefficients 

b-  (the  first  coefficient  is  the  constant  term,  a) ,  and  a 

vector  of  predicted  Y  values  and  residuals. 

For  the  analysis,  we  used  the  computer  program  "REGRESS" 

on  APL  by  taking 

(1)  a  linear  combination  of  the  characteristics,  or 

m 
Y.  =   a  +   y  b  .  X .  ,  , 

j=i 

(2)  a  linear  combination  of  logs  of  the  characteristics,  or 

m 
\    =      a  +   ^  b .  log  X^.  , 

(3)  a  linear  combination  of  logs  of  both  the  characteristics 
and  effectiveness,  or 


m 


Yj_  =   exp[a  +  I   b^  log  X^^]  , 
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(4)   a  linear  coribination  of  reciprocal  of  the  character- 
istics, or  . 


in 


■i  =   ^  ^    ^  ^  ()r-)  ' 


(5)   a  linear  combination  of  reciprocal  of  both  the 
characteristics  and  the  effectiveness,  or 


m 

1   X  ,-1 


Yi  =   [a  +  I    b  (^)] 


(6)   a  linear  combination  of  square  root  of  the 
characteristics,  or 


m 


Y.  =   a  +   y  b.  /X. .  , 
1  -   D    ij 

j  =  l 


(7)   a  linear  combination  of  reciprocal  of  square  root 
of  the  characteristics,  or 


m 


Yi  =   a  +  I   b.  (-^)  , 


.  ,    /X. . 
J  =  l      ij 


and  finally 
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(8)   a  linear  combination  of  square  root  of  both  the 
characteristics  and  effectiveness ,  or 


m 

2 


■i  =   f-  ^   ^  ^  ^^ 
j  =  l 


From  the  computer  output  (see  Appendix  B) ,  the  results 

2 
were  obtained  as  shown  in  Table  VI.   Here  R  ,  the  coefficient 

of  determination,  shows  the  proportion  of  total  variance 

accounted  for  by  the  estimating  equation  as  a  measure  of 

2 
dispersion,  and  thus  a  bigger  R   is  better.   The  third 

column  shows  the  standard  error  which  is  defined  as  the 

square  root  of  the  unexplained  variance  of  the  dependent 

variables  Y.   Therefore  the  smaller  the  standard  error, 

the  better  the  estimating  equation.   The  F-ratio  is  defined 

as 


„   _   Regression  mean  square  ,-,-,, 

Residual  mean  square 


This  F-statistic  is  used  to  test  whether  the  incremental 
improvement  associated  with  the  addition  of  a  variable  is 
significant.   Thus  the  larger  the  F-value  the  better.   The 
last  col'omn  shows  the  coefficient  of  variation  which  relates 
the  standard  error  (SE) ,  to  the  mean  of  the  dependent 
variables  Y's,  or 


CV  =  ^  .  (13) 
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Table  VI.   SUMMARY  OF  RESULTS 


REGRESSION 


R       SE 


cv 


m 


Y.  = 


.  =  a  +  y  b.X. . 


0.783    0.267    0.955   0.261 


m 

I 
j=l 


Y.    =  a+    Jh.logX-.  0.888         0.196         1.978       0.192 


m 


{.   =  exp[a+    [  b .  logX.  .] 
j=l  ^  ^ 


0.877         0.194         0.1775    0.189 


m 


1 


:=i     ij 


0.980         0.083       12.24         0.081 


"^  1        -1 


0.958         0.110         5.704       0.107 


m 


Y.    =  a+    y  b./5c~~ 
j=l  ^      ^^ 


0.838         0.236         1.29         0.231 


in 

f.   =  a+    y  b.  — — 

j=l  ^    vX" 
ij 


0.937         0.147         3.947       0.143 


m 

I 
j=l 


Y.   =    [a+    I  b.    ^.  .]^ 

1  n-i    3       13 


0.333         0.116         1.249       0.113 


a 
b 


J-3 


Effectiveness 

Constant  term 

Coefficients 

Characteristic  Data  (Table  I) 
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This  value  is  used  in  comparing  one  standard  error  with 
another;  a  lower  CV  value  is  better. 

B.   SELECTION  OF  THE  BEST  EQUATION 

Looking  at  Table  VI  ,   the  largest  measure  of  dispersion 

2 

(R  )  is  0.98.   The  smallest  standard  error  is  0.083,  the 

highest  F-ratio  is  12.24  and  the  smallest  Coefficient  of 
Variation  (CV)  is  0.081.   Fortunately,  all  of  these  best 
values  for  measures  of  fit  occur  when  we  linearly  combine  the 
reciprocals  of  the  data.   Here  the  Coefficient  of  Variation 
(CV)  is  8.1%,  which  tells  us  the  estimating  equation  is 

fitted  very  well  in  this  case. 

3 
The  coefficients   that  provided  the  good  fitting  function 

were 

-11.62 

-74.15 

27.93 

-622.54 

271  .94 

Therefore  the  best  estimating  relationship  developed  among 

those  forms  investigated  is 


EFFECTIVENESS   =   11.62  -  l±^   .27.93         622.54 


ARMOR    SILHOUETTE     SPEED 


+  2"^^-^^  (14) 

Hp/hr   •  ^^^' 


3 

See  Appendix  B. 
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The  closeness  of  the  fit  of  this  function  to  the  total 
effectiveness  values  furnished  by  the  judges  is  shown, 
for  individual  points,  in  Table  VII. 

Table  VII.   JUDGE  EFFECTIVENESS  VS  FUNCTION  EFFECTIVENESS 


JUDGE 

TANK 

EFFECTIVENESS 

LEOPARD  1 

1.44 

M60A1 

1.22 

T-62 

1.02 

M4  8A5 

0.89 

CENTURION 

0.78 

(Mk.  13) 

AMX-30 

0.78 

FUNCTION  PERCENT 

EFFECTIVNESS    DEVIATION    DEVIATION 

1,46665249  -0.266524897  1.35% 

1.165318536  0.0546814313  4.48% 

0.9953316577  0.0246683423  2.42% 

0.9391371068  -0.0491371068  5.52% 

0.8004486225  -0.0104486225  1.32% 

0.773111555    0.0068884449   0.88% 


We  can  see  from  Table  VII  that  the  percent  deviations  of 
effectiveness  for  the  six  weapon  systems  are  all  less  than 
5.52%.   This  suggests  that  the  estimating  function  of 
reciprocals  of  the  data  fits  quite  well  the  data  upon  which 
it  was  developed. 

Let's  look  at  the  results  from  another  point  of  view. 
A  common  practice  in  attempting  to  evaluate  the  effectiveness 
of  a  weapon  system  is  to  use  a  simple  linear  combination  of 
the  characteristic  values,  with  coefficients  determined  by 
any  of  several  rather  arbitrary  ways.   One  approach  which  is 
rarely  undertaken  is  to  do  as  was  done  in  this  paper,  using  a 
least  square  fit  with  effectiveness  values  obtained  from 
experts'  judgement. 
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Figure  4  shows  the  scatter  plot  of  judge  effectiveness 
vs  function  effectiveness  estimated  from  a  simple  linear 
function  of  the  characteristics,  and  Figure  5  shows  the 
scatter  plot  of  judge  effectiveness  vs  function  effective- 
ness estimated  by  taking  the  reciprocal  of  the  characteristics 

It  can  be  seen  at  a  glance  that  the  function  effective- 
ness estimated  by  taking  reciprocal  of  the  characteristics 
is  much  closer  (better)  to  the  judge  effectiveness  than 
function  effectiveness  estimated  by  just  taking  a  linear 
combination  of  the  characteristics. 

One  possible  reason  why  an  estimating  function  using 
reciprocals  of  the  characteristics  is  better  fitted  than 
the  common  procedure  of  evaluating  the  effectiveness  of 
a  weapon  system  using  a  simple  linear  combination  of  the 
characteristics ,  is  that  a  property  like  system  effective- 
ness may  possess  diminishing  marginal  returns  with  respect 
to  increasing  characteristic  values.   In  the  best  fitting 
equation  (reciprocals)  the  partial  derivative  of  effective- 
ness with  respect  to  a  characteristic  value  (with  a  negative 
coefficient)  was  then  the  reciprocal  of  the  square  of  the 
characteristic  value,  hence  diminishing  marginal  returns. 

We  have  now  developed  a  functional  relationship  between 
the  characteristics  and  the  effectiveness  of  tank  systems 
as  intended  at  the  beginning  of  the  study,  and  found  that 
the  best  estimating  equation  among  those  considered  occurred 
when  a  linear  combination  of  a  reciprocal  of  the  character- 
istics was  used. 
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The  functional  relationship  developed  in  this  manner 
could  at  least  assist  military  planners  in  two  ways: 
(1)  in  assessing  the  impact  on  effectiveness  of  a  modifica- 
tion of  characteristics  of  an  existing  tank,  and  (2)  in 
evaluating  the  effectiveness  of  a  new  (and  perhaps  unbuilt) 
tank. 

We  will  summarize  the  results  of  our  study  and  propose 
some  recommendations  for  further  study  in  the  next  chapter. 
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V.   CONCLUSIONS  AND  RECOMMENDATIONS 

In  this  chapter  we  will  give  some  conclusions  from  the 
study,  and  some  suggestions  for  further  study. 

A.   CONCLUSIONS  , 

The  principal  purpose  of  this  study  was  to  determine 
whether  we  could  compute  the  overall  effectiveness  of  a 
weapon  system  from  its  characteristics,  to  establish  the 
existence  of  functions  which  could  be  used  to  relate  system 
characteristics  and  effectiveness,  and  to  identify  the  best 
estimating  relationship.   To  do  this  we  proposed  a  procedure, 
sent  appropriate  questionnaires,  and  computed  the  overall 
effectiveness  values  for  tank  weapon  systems  by  using  the 
constant  sum  scaling  method.   Then,  using  multiple  regression, 
we  found  functional  relationships  as  in  Table  VI  and 
evaluating  these  results  we  finally  found  that  the  best 
estimating  equation  occurred  when  we  took  the  reciprocal, 
i.e.. 


m 
Y.  (Effectiveness)   =   a  +   7  h-ii^ — ) 


where 


a   =   -11.6119  is  an  intercept. 


b.,   =   (-74.149,29.926,-622.536,291.944),  and 
X.  .  are  characteristics  (Table  I) . 
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This  is  quite  an  interesting  result  because  most  people 
use  a  linear  function  in  general. 

This  approach  is  felt  to  have  merit  as  a  way  of  finding 
an  overall  MOE  because  it  is  based  on  the  opinion  of  many 
experts.   A  conspicuous  limitation  in  the  tank  example  used 
here  is  that  this  study  did  not  include  tank  characteristics 
relating  to  fire  power,  primarily  because  of  the  difficulty 
of  data  collection. 

The  scaling  for  valuing  system  effectiveness  is ,  of 
course,  independent  of  the  number  of  characteristics  or 
presence  of  data  on  those  characteristics.   This  provides, 
however,  effectiveness  values  only  for  the  instances  listed 
in  the  questionnaire.   Development  of  the  functional  rela- 
tionships between  characteristics  and  effectiveness,  unfor- 
tunately, requires  more  data  points  (instances  on  the  ques- 
tionnaire) than  characteristics  if  the  function-finding 
approach  used  here  is  employed. 

B.   RECOMMENDATIONS  FOR  FURTHER  STUDY 

We  have  shown  how  to  develop  a  model  by  which  one  can 
compute  the  system  effectiveness  directly  from  its  charac- 
teristics.  However  we  feel  that  we  don't  know  how  good  our 
model  is.   To  test  our  model,  we  suggest  the  following 
method  which  could  be  part  of  a  further  study. 

(1)  Select  instances  A.B.C.D.E  (or  any  number  of 
instances) 

(2)  Send  questionnaires  on  A.B.C.D.  (excluding  instance 
E.  )  . 
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(3)  Find  the  best  function 

^i   =   f(^l'^2 V 

(4)  Predict  the  Y  value  using  the  above  estimating 
equation. 

(5)  Send  questionnaires  on  A.B.C.D.E  (including  the 
excluded  instance) . 

(6)  Compute  the  Y_  value  using  the  constant  sum  scaling 
method  and  expert  opinion. 

(7)  Comparing  those  two  effectiveness  values  computed 
in  step  (4)  and  (6),  provides  a  test  of  our  model. 

It  is  hoped  that  the  work  presented  here  will  be  useful 
to  both  those  interested  in  tank  effectiveness  measurement 
and  those  concerned  with  multiple  MOE  research  problems. 
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APPENDIX  A 

QUESTIONNAIRE 
PROBLEM  DESCRIPTION 


A  fundamental  problem  in  Operations  Research  is  that  of  satisfactorily 
combining  various  MOEs  for  a  system  into  a  single  measure  of  overall 
effectiveness.    A  variety  of  methods  have  been  used  out  of  necessity,  with 
the  weighted  sum  of  MOEs  being  perhaps  the  most  frequent  expedient.   However, 
both  the  values  of  the  weights  and  the  notion  of  adding  the  MOEs  are  usually 
difficult  to  justify,  and  this  approach  often  yields  results  which  differ 
sharply  from  expert  judgment. 

The  premise  of  our  study  at  NFS  is  that  individuals  with  expertise 
regarding  the  phenomenon  (in  our  case,  tanks)  possess  judgmental  ways  of 
combining  MOEs  which  are  far  superior  to  the  analyst's  simple  weighted 
average.   The  difficulty  is  that  the  expert  usually  cannot  tell  us  how 
he  knows,  say,  that  on  the  basis  of  given  data  Tank  A  is  superior  to  Tank  B. 

Our  investigation  seeks  a  procedure  to  approximate  the  way  experts 
put  MOEs  together  to  form  a  single  measure  of  effectiveness.   This  approach 
crosses  disciplinary  lines  in  that  we  use  scaling  techniques  from  the 
behavioral  sciences  together  with  nonlinear  regression  methods  from  statistics. 

The  heart  of  the  approach,  of  course,  is  data  from  knowledgeable  people, 
obtained  through  a  specialized- questionnaire.   The  research  is  still  in 
its  infancy,  and  the  current  effort  seeks  a  small  amount  of  data  about 
a  reduced  set  of  MOEs,  for  use  in  development  and  assessment  of  this 
approach. 


Degree  Candidate:  H.B.  Kim,  Lt,  Col.,  Korean  Army 

Adviser:  G.F.  Lindsay,  Assoc.  Prof,  of  Operations  Research,  Maval  Postgraduate 

School. 
24  October,  1978 
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EFFECTIVENESS  OF  A  TANK  WEAPONS  SYSTEM 


A  study  is  being  made  of  various  measures  of  effectiveness  applicable 
to  a  tank,  and  how  they  relate  to  overall  effectiveness.   Judgments  reflect- 
ing your  experience  and  expertise  are  solicited. 

Both  parts  of  this  questionnaire  have  purposefully  been  kept  short,  and 
we  ask  only  two  or  three  minutes  of  your  time. 
A.   Importance  of  Tank  Effectiveness  Factors. 

Please  split  100  points  within  each  pair  listed  below,  assigning  a  higher 
mamber  to  a  factor  you  think  is  more  important.   For  example,  if  you  think 
that  fire  power  is  much  more  important  than  armor,  you  might  split  the  100 
points  as  follows: 

Fire  Power    80   ,       Armor    20 


Or,  if  you  thought  them  to  be  equal  in  importance,  you  would  write: 


Fire  Power 


50 


Omit  pairs  you  feel  unable  to  rate 
1 .   Range ,  Road 


2. 

Range ,  Road 

3. 

Range ,  Road 

4. 

Range ,  Road 

5. 

Range,  Road 

6. 

Speed 

7. 

Speed 

8. 

Speed 

9. 

Speed 

10. 

Fire  Power 

11. 

Fire  Power 

12. 

Fire  Power 

13. 

HP/ton 

14. 

HP /ton 

15. 

Armor 

Armor 


50 


Fire  Power 

HP /ton 

Armor 

Speed 

Silhouette_ 

Fire  Power 

HP/ton 

Armor 

Silhouett6_ 

HP /ton 

Armor 

Silhouette 

Armor 

Silhouette 

Silhouette 


44 


B.   Overall  Combat  Effectiveness  of  Existing  Tank  Weapons  Systems 


FACTORS 

M48Ar 

M60A1 

AMX-30 

r      — 1  .  --  , 

LEOPAPX)  1 

T-62 

CENTURION 
(Mk.l3) 

RANGE , ROAD 
(km) 

482 

500 

650 

600 

500 

190 

FIRE  POWER 
(main  gun) 

105 

105 

105 

105 

115 

105 

SPEED 
(km/hr) 

48.2 

48.3 

65 

65 

50 

34.6 

HP/ton 

15.9 

15.3 

19.4 

20.7 

19.2 

12.5 

ARMOR 
(mm  on  nose) 

110 

110 

40 

70 

100 

118 

SILHOUETTE 
(height  in  m) 

3.09 

3.26 

2.85 

2.64 

2.4 

3.01 

Some  characteristics  of  six  current 
split  100  points  within  each  pair  listed 
effectiveness  of  the  tank  weapons  system 


1. 

M48A5 

2. 

M48A5 

3. 

M48A5 

4. 

M48A5 

5. 

M48A5 

6. 

T-62 

7. 

T-62 

8. 

T-62 

9. 

T-62 

10. 

AMX-30 

11. 

AMX-30 

12. 

AMX-30 

13. 

CENTURION 

14. 

CENTURION 

15. 

LEOPARD  1 

tanks  are  shown  above.   Please 
below,  in  terms  of  the  overall 


M60A1 

AMX-30 

LEOPARD  1 

T-62 

CENTURION 

M60A1 

AMX-30 

LEOPARD  1 

CENTURION 

M60A1 

LEOPARD  1 

CENTURION 

M60A1 

LEOPARD  1 

M60A1 


Thank  you  very  much  for  your  time  and  cooperation. 
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APPENDIX  B 
MULTIPLE  REGRESSION  OUTPUT  ON  APL 


V  Z<-Y  REGRESS  X  ;  N  J  K  J  C  ?  XPXINU  ?  XPY  5  BETA  ?  RSS  J  TSS  5  S2  ?  ESS  ?  UID  y  DEP 

1:1.  ;i  X^(2t  (pX)  r  1  )  pX 

i:2:j  Xf-coi- 1-aintercept)  ii^x 

1:3:  XPXINU<-S(^X)  f  >.<X 

1:43  BETA+-XPXINIv'+.xXPY>("«X)  +  .xY 

\:51  RSS^<:  (*^BETA)  +  .xXPY)-C<-(  (  f/Y)*2)  ^N+-p  r  Y 

116  3  E3S<-(TSSf-(  ('<;(Y)  +  .xY)-C)-R3S 

1171  S2^»ES3^(N-1  ) -KX  p  r  BETA  ) -<i INTERCEPT 

IIBH  CR 

£91  '  ANOVA' 

1:103  CJJ<- 'SOURCE /DF^  SUM    SQUARES  »  MEAN    SQUARE  >•  F-RATIO  ' 

1: 1 1  J  '     ' 

r.l21  'I!1REGRESSI0NIZI.I4,BE16,4'     FMT(K)  ,  (  .RS3)  f  (  yRSS-K)  »  (  yRSS-^K)-32 

1:133  CU^'  ' 

1:143  'n       RE3IDUALaTr4»BEl6.4'     FMT  (  (  N-1  ) -K  )  ?  <  »  ESS  )  >- 32  »  0 

1:153  'QTOTAL  □yI4i-BEl6.4'     FMT  (  N-1  )  ?  (  >  TSS  )  .  0  !- 0 

i:i63  '      ' 

1:173  'R  square:   'JyRSS^TSS 

1:1 3 3  'STD  error:  '?f32*0,5 

C193  Cld<-'COEFFICIENTSrT    STATISTICS' 

1:203  'F15.4'     FMT'5(2y  p  i.BETA)p(  fBETA)  7  (  !.BETA)^(1     1    !SU<-32xXPXIN'v' )  ;V0  .  i 
5 

1:213  'DO  YOU  WANT  A  PRINTOUT  OF  THE  VARIANCE-COUARI ANCE  MATRIX-;" 

1:223  -*Alxi  '  Y'?:lta 

C233  'VARIANCE-COVARIANCE  MATRIX:  '.CfcK-'' 

1:243  'E12.4'  FMT  'J 

C25  3  Ai:  'DURBIN-UATSON:  '?(+/((  14  >.C)-(~"li  7  C)  )*2)-  +  /(  ?C<-Y-Xf  *xBETA)*2 

1:26  3  H->Si(2fM)p(  /X+.xBETA)  f  s- C 

1:273  Bi:'DO  YOU  WANT  TO  FORECAST  A  UALUE  FOR  Y?  ' 

i:283  -»Clxi  '  Y'j'ltlll 

C293  'ENTER    X    VECTOR     <'?K;'     VALUES)' 

1:303  'FORECAST    OF    Y    UALUE  :      '  5  (  C<- (l-<iINTERCEPT  )  J- 1  ?  a  )  +  .  xBETA 

1:313  'VARIANCE    OF    FORECAST    ERROR:     '  ?  S2x  lfC+ .  XXPXINV+ .  xfsC 

1:323  -*B1 

C333  CIJ'DO  YOU  WANT  TO  SCAT  RESIDUALS  VS.  PREDICTED  Y? ' 

1:343  -?Oxi  'N'=ltn 

C353  DEP<-0.5xUID<-L/70>-  (T/i  (0.75xN)  .30)  ) 

i:363  SCAT    Z 
•7 
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70 
110 
100 
110 
118 

40 


2.64 

3.26 

2.4 

3.09 

3.01 

2.85 


65 

48.3 

50 

48.2 

34.6 

65 


20.7 
15.3 
19.2 
15.9 
12.5 
19.4 


1.44 


Y 

1.22 


1.02   0.89   0.79   0.78 
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Y       --,  (-  r-.  1",  I—  r*  ,-^       n/ 
T      I  M_  u  r\  L'_  ■..)  sj      A 


3CURCE  DF 

REGRESSION  '> 

RESIDUAL  1 

TOTAL  S 


A  NO',' A 

SUM  SQUARES 
2»7245E~1 

-I  -i  <~k  r\  /  r-  —  r-^ 
/  ♦  .L  *-  K.J  O  U.  *- 
—     .  -y  .-,  -y  f. 


MEAN  SQUARE 
6.3112E~2 

/     *    .L  *;.  O  O  fcl        *^ 


r -RAT IS 
9 . 5547E~1 


R  square:   0.792. 

L  -]   T  Q 

1.29 

STD  error:  0,26699  46 

::■  •■:•  t 

COEFFICIENTS 

T 

iSTATISTICS 

2.3863 

0.3699 

0.0251 

1.  ■i535 

"1.6073 

"0.7715 

0.1405 

1.0579 

"0.3682 

"0.764 

DO 

Y 


;U  WANT  A  RRINTSUT  OF  THE 


I A  N  C  E  -  C  0  U  A  R I  :-i  N  C  E  M  A  I R I X  : 


DU 
DO 
N 
DO 


4.1616Ef 1 

7,3596E-2 
~i.2S16E-fl   ■■ 

7.3682E~1 
~2.8942E00   " 
RB IN- WATS ON* 

YOU  WANT  TO 


2.9907E~4 
■3.0556E"2 
2.1268E-3 
■-'.  1347E"3 
2,006601651 
FORECAST  A  UALUE  FOR 


1  . 

2016EI1 

-7 

36S2F~  J 

"2.3942E0O 

T 

0556E~2 

i  »_  Q  3  t.   >  J 

"7.1347E~3 

4. 

3399E00 

-  . -V 

<■.  c-  c;  -T  rr  —  1 
o  %j  --J  -.-*  1™  i. 

9.3432E"1 

,*% 

6553E-1 

1. 

7''j33E"2 

"6.3026E~2 

9  , 

3432E~1 

6  . 

3026E"2 

.— ,     -7  .— ,  — /  —f   |—  —  ^ 

-w  *  -.J  *—  -J  nJ  C     .4. 

YOU  WANT  TO  SCAT  RESIDUALS  '.'S .  PI 


DICTED 


RA 
RA 


NGE  OF 
NGE  OF 


0.6 


0.2 


1 


^ 

/ 


1.410903046 

0  . 

02909695409 

1.062459362 

0. 

X  vJ  ,'  sj  -t  V  O  U  O  ■■+ 

0.9959965633 

0. 

0240034-3169 

1.100700476 

"0. 

2107004762 

0  . 

^-\  f  ,-*  ,-\  (—  --1  -T  -r -"^  -T o 
■■-■  .1,  -.3  j'  ^J  •:_  *_  ^.j  *_  w  O 

0 . 7979927303 

"0. 

0"!  79927""''03 
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\ 


-^- 


Y  REGRESS  *X 


ANOVA 


SOURCE   DF 

SUM  SQUARES 

MEAN  SQUARE 

F-RATIO 

REr7RESSI0N    4 

3.0517E"!        7 

. 6292E-2 

1.9782E00 

RESIDUAL    1 

3.a565E~2        3 

.S565E~2 

TOTAL         5 

3.4373E-1 

R  square:   0.88 

78042559 

STD  error:  0.19 

63807962 

COEFFICIENTS 

T  STATISTICS 

"4.6385 

"1.0011 

1.5055 

2.3534 

"7.2268 

"1.4786 

9.6399 

1 . 7563 

"11.0647 

"1.5005 

-COVARIANCE 

MA^ 

DO  YOU  WANT  A  F 
Y 

uariance-couari 

RINTOUT  OF  THE  'v'ARIANCE- 

PRIX? 

ANCE  matrix: 

2.1470E+1   - 

9.4373E"2   "1.1615E+1 

9.0073E00 

"1 

5628E+1 

"9.4373E-2 

4.0924E~1   "2.5707E00 

3.1039E00 

"3 

9644E00 

-1.1615E+1   - 

2.5707E00    2.3888E+1   " 

-2.6094E+1 

3 

5500E+1 

9.0073E00 

3.1039E00   "2.6094E+1 

3.0126E+1 

"4 

0196E+1 

-1.5628E+1   - 

3.9644E00    3.5500E+1   " 

-4.0196E+1 

5 

4374E+1 

durbin-watson: 

2.080517414 

DO  YOU  LJANT  TO 

DO  YOU  WANT  TO 

Y 

RANGE  OF  X:  0.6 

FORECAST  A  ^JALUE  FOR  Y? 

SCAT  RESIDUALS  ^;S.  PREDICTED  Y-;* 

1.6 

RANGE  OF  Y:  "0. 

1 

15   0.15 

1.455072367 

1.093099258 

0.9840070802 

1.034541009 

0.7961936605 

0.777086625 


"0.01507236729 
0.1269007416 
0.03599291975 
'0.1445410085 
■0.006193660469 
0.002913375008 
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(*Y)  REGRESS  («X) 


ANOUA 


SOURCE 

i:iF 

SUM  SQUARES 

MEAN  SQUARE 

F~RATIO 

REGRESSION 

4 

2.6622E-1 

6.6555E-2 

1.774AE00 

RESIDUAL 

1 

3.7504E-2 

3.7504E~2 

TOTAL 

5 

3.0373E~1 

R  square:   0.8765 

198175 

STD  error:  0.1936 

598687 

COEFFICIENTS 

T  STATISTICS  | 

-6.0277 

~1.3192 

1.3669 

2.1668 

"5.9679 

"1.2382 

8.1447 

1.5047 

-9. 1104 

- 1 .2529 

DO  YOU  WANT  A  PR  I 

NTOUT 

:)F  THE  U,< 

Y 
UARIANCE- 


COUARIANCE 


matrix: 

9.1776E-2 

3.9798E-1 

2.5000E00 

3.0185E00 

3.8553E00 

2.080517414 

FORECAST  A  l^ALUE 


'1 


3 


E  UARIANCE 

-COUARIANCE 

MATRIX-^ 

.  1295E+1 

8.7594E00 

-1.5198E+1 

. 5000E00 

3.0185E00 

-3.3553E00 

.3231E+1 

-2.5376E+1 

3.4523E+1 

.5376E+1 

2.9297E+1 

-3.9090E+1 

.4523E+1 

"■3.9090E+1 

5.2878E+1 

2.0879E+1       ■ 
-9. 1776E-2 
•~1.1295E+1 

a.7594E00 
■"1.5198E+1 

durbin-uatson: 

no  YOU  WANT  TO 

N 

no  YOU  WANT  TO  SC^T    RESinUALS  ^S .  PREDICTEn  Y' 

Y 

RANGE  OF  X:  "0.4 

RANGE  OF  Y:  ~0.15 


FOR  Y' 


0.3795066478 
0.07370837312 
"0.01569159746 
0.02600452402 
■0.2296144885 
"0.2513343684 


0.4 
0.15 


■0.01486353417 
0.1251424856 
0.03549422475 
'0.1425383403 
■0.006107845058 
0.002873009127 
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TX>1- 


Y  REGRESS  TX 


ANOUA 


SOURCE 

DF 

SUM  SQUARES 

REGRESSION 

4 

3.3685E~1 

RESIDUAL 

1 

6.8800E"3 

TOTAL 

5 

3.4373E-1 

MEAN  SQUARE 
8,4213E"2 
6,8800E~3 


F-RATIO 
1,2240E+1 


R  square:   0.9799 

844 

232 

STD  error:  0.0829 

458 

9169 

COEFFICIENTS 

T 

STATISTICS 

"11.6119 

"3.4369 

"74.1488 

"6.2379 

27,9259 

4.2011 

"622.5395 

"4.6658 

271.9441 

4.2671 

no  YOU  WANT  A 

Y 

VARIANCE-COUAR 

='RINTOUT  OF  THE  UARIANCE-COVARIANCE 

MATRIX';' 

lANCE  matrix: 

1.1415E1 

2.7450E1    "2.2374E1     4.3981E2 

"2.1281E2 

2.7450E1 

1.4130E2    "5.7579E1     1.2390E3 

"5.6655E2 

"2.2374E1 

"5.7579E1     4.4187E1    ~8.7077E2 

4.13<55E2 

4.3981E2 

1.2390E3    "a.7077E2     1 . 7803E4 

"3.4757E3 

-2.1281E2 

"5.6655E2     4.1895E2    -8.4757E3 

4.0615E3 

durbin-uatson: 

2.145430874 

DO  YOU  WANT  TO 

N 

DO  YOU  WANT  TO 

Y 

RANGE  OF  X:  0. 

FORECAST  A  'JALUE  FOR  Yt' 

SCAT  RESIDUALS  US.  PREDICTED  Y? 

6   1,6 

RANGE  OF  Y:  "0 

.06   0.06 

1.46665249 

1.165318568 

0.9953316577 

0.9391371068 

0.8004486225 

0.773111555 


"0.02665248971 

0.05468143179 

0.02466834227 

■0.04913710681 

■0.01044862252 

0 . 006888444973 
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u,n>  rn^igRiiiiss  {i^^} 


ANOVA 


SOURCE 

EiF 

SUM  SQUARES 

MEAN  SQUARE 

F-RATIO 

DEGRESSION 

4 

2.7511E-1 

6*8777E~2 

5.7039E00 

RESIDUAL 

1 

1.205aE"2 

1.2058E-2 

TOTAL 

5 

2.S717E-1 

R  square:   0.9580105484 
3TD  error:  0.  J.098086393 

COEFFICIENTS    T  STATISTICS 

9.9859  2.2326 

65.7943  4.181 

"20.6599         -2.3477 

471.4091  2.6688 

-200.6539         "2.3783 


DO  YOU  WANT  A  PRINTOUT  OF  THE  VARIANCE- 

Y 

(^ARIANCE-CO^ARIANCE  MATRIX: 

■COVARIANCE 

MATRIX? 

2.0005E1     4.8109E1    -3.9213E1 

7.7082E2 

-3.7296E2 

4.8109E1     2.4764E2    -1.0091E2 

2.1714E3 

"9 . 9294E2 

-3.9213E1    "1.0091E2     7.7442E1 

-1.5261E3 

7.3424E2 

7.7082E2     2.1714E3    "1.5261E3 

3. 1201E4 

-1.4854E4 

-3.7296E2    "9.9294E2     7.3424E2 

-1.4854E4 

7.1182E3 

durbin-uatson:  2.145430874 

DO  YOU  WANT  TO  FORECAST  A  VALUE  FOR  Y? 

N 

DO  YOU  WANT  TO  SCAT  RESIDUALS  VS.  PREDICTED  Y? 

Y 

RANGE  OF  X:  0.6   1.4 

RANGE  OF  Y:  "0.08   0.08 

0.6591603144 

0 

03528413003 

0.8920626197 

-0 

07239048852 

1.013049556 

"0 

03265739921 

1.05854492 

0 

06505058572 

1.251990285 

0 

01383249969 

1.29117061 

"0 

00<31  1  QT-777':> 
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Y    REGRESS    X*,5 


ANOVA 


SOURCE  riF 

REGRESSION  4 

RESIDUAL  1 

TOTAL  5 


SUM  SQUARES 
2.S793E~1. 
5.5799E"'2 
3.4373E-1 


MEAN  SQUARE 
7.1984E-2 
5*5799E~2 


F-RATTO 
1 .2900E00 


R  square:   0.837 

667: 

L578 

STD  error:  0.236 

2185618 

COEFFICIENTS 

T 

STATISTICS 

9.6981 

0.7228 

0.3986 

1.8048 

-7.0421 

" 

"1.0655 

2.3585 

1.3374 

-4.2137 

" 

"1  .0744 

no  YOU  UANT  A  PRINTOUT  l 

]F  THI^  ^ 

ftRIANCE-COVARIANCE  MATRIX? 


1 
2 

"8. 

■-> 


2.1507E00 

4.8783E-2 
■1.2281E00 

3.5430E-1 
"7.4316E-1 

2.038119584 

FORECAST  A  VALUE 


Y 

UARIANCE-CO'v'ARIANCE    MATRIX: 

.8003E+2 

1507E00 

6857E+1 

1746E+1 

•"5.0610E+1 

durbin-uatson: 
do  you  want  to 

N 

DO 

Y 

RANGE  OF  X: 

RANGE  OF  Y: 

I 

I 

I 


8.6857E+1 

2.1746E+1 

-5.O6IOE+I 

1.2281E00 

3.5430E-1 

-7.43I6E-I 

4.3683E+1 

-1.1273E+1 

2.5479E+1 

1.1273Efl 

3.1101E00 

-6.8470E00 

2.5479E+1 

-6.8470E00 

1.5331E+1 

FOR  Yi* 


YOU  WANT  TO  SCAT  RESIDUALS  US.  PREDICTED  Y' 


0.6 
-0.2 


1.6 
0.15 


1.434688413 

1.073082645 

0.988212396 

1.071996205 

0.7859517492 

0.7860685924 


0.005311587208 

0.1469173555 

0.03178760399 

■0.181996205 
0.00404825083 

"0.006068592406 
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Y  REGRESS  (l-;-X*.5 


ANOVA 


SCDURCE 

DF 

SUM  SQUARES 

MEAN  SQUARE 

F-RATIO 

REGRESSION 

4 

3,2224E-1 

8.0559E~2 

3.7474E00 

RESIDUAL 

1 

2,1497E~2 

2.1497E-2 

TOTAL 

5 

3.4373E"! 

R  square:   0.937 

4595357 

STEi  error:  0.1466193789 

COEFFICIENTS 

T 

STATISTICS 

-18.7584 

■" 

-1.7598 

"21.7109 

-3.367 

28.7162 

2.2021 

"155.6577 

"2.5165 

111 .2614 

2.2382 

YOU  WANT  A 


DO 
Y 

^ARIANCE-COVARIANCE  MATRIX: 

1.1362E2 

5.0221E1 

■-1.3817E2 

6.3622E2 

"■5.21ie£2 

durbin-uatson: 
do  you  want  to 

N 

DO  YOU  UANT  TO 

Y 

RANGE  OF  X:  0.6 

RANGE  OF  Y:  ~0 . 1 

I 

i 

I 


•RINTOUT    OF     THE    UAR I  ANCE-CO^'ARIANCE    MATRIX:' 


"  1. 38 17E2 
"6.6284E1 

1.7005E2 
'7.8844E2 

6.3979E2 


6. 
3. 

3  • 

"3. 


3622E2 
3699E2 
8844E2 
8260E3 
0602E3 


5. 0221  El 

4.1S80E1 
~6.6284E1 

3.3699E2 
"2.5875E2 
2.122115702 
FORECAST  A  VALUE  FOR  Y-;* 

SCAT  RESIDUALS  VS.  PREDICTED  Y'!' 

1.6 

0.1 


.2118E2 
5875E2 
3979E2 
0602E3 
4711E3 


I 


•1.467833212 

"0.02783321172 

1.12315161 

0.09684839049 

0.9852532576 

0.03474674236 

0.9897234947 

"0.09972349474 

0.8015763548 

"0.01157635483 

10.7724620716 

0.007537928422 
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(Y».5)  REGRESS  (X»,5) 


ANOUA 


SOURCE  ni- 

REGRESSION  4 

RESIDUAL  1 

TOTAL  5 


SUM  SQUARES 
6.6737E~2 
1*3354E"2 
8.0091E""2 


MEAN  SQUARI 
1,6684E"; 
1*3354E~; 


■-RATIO 
:4?4E00 


R  square:   0,833 

2679272 

STD  error:  0.1155581755 

COEFFICIENTS 

T 

STATISTICS 

4.6632 

0.7104 

0.1884 

1.7438 

"3.1607 

-0.9776 

1.076 

1 .2472 

"1 .8862 

~0.9831 

'do  you  want  a  printout 

OF  TlH!^  U 

f^'^RIANCE-COVARIANCE    MATRIX? 


Y 
UARIANCE- 


COUARIANCE  MATRIX: 


N 


Y 

RANGE 
ANGE 


4.3085Efl 
5. 1469E-1 

"2.07S6E+1   "" 
5.2041E0O 

■~1.2112E+1   " 

urbin-uatsqn: 
0  you  want  to 


"1 
■n 


5.1469E" 

1 .1675E" 

2.9389E~1  1 

S.4790E-2       "2 

■1.77S5E-1  6 

2.038119584 

FORECAST  A  VALUE  FOR  Y' 


.  0786E+1 

9389E~1 

0454E+1 

.  6978E00 

,  0975E00 


5.2041E00 
4790E-2 
697SE00 
4430E-1 
6386E0O 


0  YOU  WANT  TO  SCAT  RESIDUALS  US.  PREDICTED  Y' 


OF 
OF 


x: 
y: 


0.35 

"0.1 


1.2 
0.1 


1.19740157 

0.002598429701 

1.032664097 

0.07187200443 

0.9943999906 

0.01555050326 

1.032430699 

"0.08903258577 

0.8863390365 

0.001980405251 

0.8861448434 

"0.002968756311 

"1 .2112E+1 
'1.77S5E-1 

6.0975E00 
"1.63S6E00 

3.6810E00 
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APPENDIX  C 

COMPUTATION  OF  A  RATIO  SCALE  OF  THE 
IMPORTANCE  OF  SIX  MAJOR  FACTORS  OF 
A  TANK  WEAPON  SYSTEM,  USING  THE 
CONSTANT  SUM  SCALING  METHOD 


As  a  supplementary  study,  we  computed  a  ratio  scale 
of  the  importance  of  six  major  factors  of  a  tank  weapon 
system.   The  factors  were: 

Road  Range, 
Fire  Power, 
Speed, 
Hp/ton, 
Armor ,  and 
Silhouette. 

As  we  did  in  Chapters  II  and  III  for  system  effectiveness, 
we  followed  the  same  procedure,  i.e.,  we  selected  the 
major  factors,  collected  data,  selected  the  constant  sum 
scaling  method,  sent  questionnaires  together  with  the  ques- 
tionnaires for  tank  weapon  system  (Appendix  A) ,  and  computed 
the  ratio  scale  values  about  the  importance  of  each  of  the 
six  major  factors. 


The  a. .  array  was  computed  from  the  5  0  judges  responses 


and  we  computed  the  W^ •  array  from  this  a^ .  array  by  taking 
the  ratio  of  the  average  points  awarded  to  instance  j  (when 
compared  to  instance  i)  to  the  average  points  awarded  to 
instance  i  (when  compared  to  instance  j).   After  constructing 
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the  W..  array  we  used  equation  (11),  i.e, 


n 


1/n 


1     (W   )^/"  ,   j  =  1,2, 


n 


1=1 


to  get  the  ratio  scale  values  of  factors.   The  ratio  scale 
values  computed  are  shown  in  Table  C,  and  represented 
graphically  in  Figure  a. 


Table   A. 

a .  . 

ARRAY    COMPUTED    FROM 

JUDGES 

RESPONSES 

RANGE, 
ROAD 

FIRE 
PCWKR 

SPKKI) 

HP/'iU^ 

ARMOR 

STTHOUhTl'E 

RANGE,    ROAD 

50 

75 

58.7 

59.8 

66 

63.3 

FIRE  POWi::R 

25 

50 

32.5 

30.7 

38.3 

36.6 

SPEED 

41.3 

69.5 

50 

43.1 

58.7 

55.6 

HP/'i'UN 

42.2 

63.3 

50.9 

50 

59.3 

54.7 

ARMOR 

34 

61.9 

41.3 

42.7 

50 

55.5 

STTHOUhTTK 

36.4 

63.4 

44.4 

45.3 

54.5 

50 

57 


.  Table   B 

W. .    ARRAY 

RANGE, 

FIRE 

ROAD 

PCWKR 

SPKKI) 

HP/TON 

ARMOR 

STTHOULTi'E 

RANGE,    ROAD 

1 

3 

1.421 

1.369 

1.941 

1.949 

FIRE  POVER 

.333 

1 

.481 

.443 

.621 

.599 

SPKKI) 

.703 

2.099 

1 

.965 

1.421 

1.252 

HP/TON 

.730 

2.259 

1.037 

1 

1.342 

1.209 

ARMCR 

.515 

1.611 

.703 

.745 

1 

.835 

suhouette 

.592 

1.932 

.798 

.828 

1.198 

1 

.61 


1.84 


,86 


.84 


1.18 


1.04 


Table  C   RATIO  SCALE  OF  SIX  MAJOR 
FACTORS  OF  TANK  WPN.  SYS. 


FACTORS 

FIRE  POWER 

ARMOR 

SILHOUETTE 

SPEED 

HP/TON 

RANGE ,  ROAD 


RATIO 

SCALE 

1. 

.84 

1. 

.18 

1. 

.04 

0. 

.86 

0, 

.84 

0. 

.61 
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2.0 


1.5._ 


1.0-- 


0.5 


01- 


-«   FIRE  POWER 


-A      ARMOR 


■^   SILHOUETTE 
.   SPEED 


HP/TON 
-o   RANGE ,  ROAD 


FIG.  a   RATIO  SCALE  OF  SIX  MAJOR  FACTORS 
OF  TANK  WEAPON  SYSTEM 
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Thesis 
r.2 


/  181606 

aonrenstion  of  rnftas- 
ures  of  effectiveness 
with  constant  sum  scal- 
ing method  and  multiple 
regression. 


thesK4147 

Aggragation  of  measures  of  effectiveness 
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